🏠 Self-hosted AI

Model Optimization, Inference Engines, LLM Quantization, Privacy-focused Deployments

AirLLM: Diffusion Policy-based Adaptive LoRA for Remote Fine-Tuning of LLM over the Air
arxiv.org·7h
🏗️AI Infrastructure
Sandboxing AI - Extending AI Responsibly
dev.to·21h·
Discuss: DEV
🤖AI agents
Deploying AI to prod at enterprises is a largely unsolved problem
credal.ai·15h·
Discuss: Hacker News
🧠AI
Enabling Differentially Private Federated Learning for Speech Recognition: Benchmarks, Adaptive Optimizers, and Gradient Clipping
machinelearning.apple.com·2d
🤝Federated Learning
A Minimal DDPM
github.com·9h·
Discuss: Hacker News
👥Digital Twins
Huawei's star AI model was built on burnout and plagiarism
the-open-source-ward.ghost.io·12h·
Discuss: Hacker News
🏗️AI Infrastructure
The Fine-Tuning Revolution: How PEFT, LoRA, and QLoRA Are Democratizing AI Customization in 2025
dev.to·3h·
Discuss: DEV
🏗️AI Infrastructure
Why LLMs demand a new approach to authorization
infoworld.com·2d
🤖AI agents
PLEX: Perturbation-free Local Explanations for LLM-Based Text Classification
arxiv.org·7h
💻Local LLMs
How far can reasoning models scale?
epoch.ai·7h·
Discuss: Hacker News
🏗️AI Infrastructure
An LLM Router That Thinks Like an Engineer
medium.com·17h·
Discuss: Hacker News
🕸️Mesh Networks
Let AI Tune Your Voice Assistant
towardsdatascience.com·1d
🎙️Whisper
I Built an Open Source Offline ChatGPT Alternative in 40MB
news.ycombinator.com·1d·
Discuss: Hacker News
🎙️Whisper
GHPO: Adaptive Guidance for Stable and Efficient LLM Reinforcement Learning
arxiv.org·7h
💻Local LLMs
SENSOR: An ML-Enhanced Online Annotation Tool to Uncover Privacy Concerns from User Reviews in Social-Media Applications
arxiv.org·7h
💻Local LLMs
The AI Framework Trap
hackernoon.com·1d
🤖AI agents
Building an AI-Powered Image Search Engine with Daft.ai
dev.to·6h·
Discuss: DEV
🏗️AI Infrastructure
How PayU built a secure enterprise AI assistant using Amazon Bedrock
aws.amazon.com·13h
☁️Serverless Rust
The Man Behind the Sound: Demystifying Audio Private Attribute Profiling via Multimodal Large Language Model Agents
arxiv.org·1d
🎙️Whisper
Fine-tuning Large Language Model for Automated Algorithm Design
arxiv.org·7h
💻Local LLMs